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Abstract 



CD ' Consider a MIMO interference channel whereby each transmitter and receiver are equipped with 



multiple antennas. The basic problem is to design optimal linear transceivers (or beamformers) that can 
maximize system throughput. The recent work [TJ suggests that optimal beamformers should maximize 
the total degrees of freedom and achieve interference alignment in high SNR. In this paper we first 
consider the interference alignment problem in spatial domain and prove that the problem of maximizing 
q | the total degrees of freedom for a given MIMO interference channel is NP-hard. Furthermore, we show 

that even checking the achievability of a given tuple of degrees of freedom for all receivers is NP-hard 
when each receiver is equipped with at least three antennas. Interestingly, the same problem becomes 
polynomial time solvable when each transmit/receive node is equipped with no more than two antennas. 
Finally, we propose a distributed algorithm for transmit covariance matrix design, while assuming each 
receiver uses a linear MMSE beamformer. The simulation results show that the proposed algorithm 



outperforms the existing interference alignment algorithms in terms of system throughput. 
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I. Introduction 

Consider a multiuser communication system in which a number of users must share common resources 
such as frequency, time, or space. The mathematical model for this communication scenario is the well- 
known interference channel, which consists of multiple transmitters simultaneously sending messages to 
their intended receivers while causing interference to each other. Interference channel is a generic model 
for multiuser communication and can be used in many practical applications such as Digital Subscriber 
Lines (DSL) (3), Cognitive Radio (CR) systems |Q and ad-hoc wireless networks Il5l, |[6l. 

A central issue in the study of interference channel is how to mitigate multiuser interference. In 
practice, there are several commonly used methods for dealing with interference. First, we can treat the 
interference as noise and just focus on extracting the desired signals (see |fT5ll , ETlD . This approach is 
widely used in practice because of its simplicity and ease of implementation, but is known to be non- 
capacity achieving in general. An alternative technique is channel orthogonalization whereby transmitted 
signals are chosen to be nonoverlapping either in time, frequency or space, leading to Time Division 
Multiple Access, Frequency Division Multiple Access or Space Division Multiple Access respectively. 
While channel orthogonalization effectively eliminates multiuser interference, it can lead to inefficient 
use of communication resources and is also generally non-capacity achieving. Another interference 
management technique is to decode and remove interference. Specifically, when interference is strong 
relative to desired signals, a user can decode the interference first, then subtract it from the received 
signal, and finally decode its own message (see [8] and IfTTI ). This method is less common in practice 
due to its complexity and security issues. 

In a cellular system, multi-cell interference management is a major challenge. So far various base 
station cooperation techniques have been proposed to mitigate inter-cell interferences, including multi- 
point coordinated transmission, or network MIMO transmission H31 - B31 . Most of these techniques 
require each base station to have full/partial channel state information (CSI) as well as the knowledge 
of actual independent data streams to all remote terminals. With the complete sharing of data streams 
and CSI, the multi-cell scenario is effectively reduced to a single cell interference management problem 
with either total |46ll or per-group-of-antennas power constraints |47ll , |48l . While these techniques can 
offer significant improvement on data throughput, they also have several drawbacks including stringent 
requirement on base station coordination, the large demand on the communication bandwidth of backhaul 
links, and the heavy computational load associated with the increasing number of cells |49ll , l50l . 

Theoretically, what is the optimal interference management strategy? The answer is related to the 
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characterization of capacity region of an interference channel, i.e., determining the set of rate tuples 
that can be achieved by the users simultaneously. For the noiseless case, the capacity region and the 
optimal precoding strategy of the two user interference channel is discussed in [8] and Q. In spite 
of intensive research on this subject over the past three decades ( - EOll ). the capacity region of 
interference channels is still unknown for general case (even for small number of users). The lack of 
progress to characterize the capacity region for a MIMO interference channel has motivated researchers to 
derive various approximations of the capacity region. For example, the maximum total degrees of freedom 
(DoF) corresponds to the first order approximation of sum-rate capacity of an interference channel at high 
SNR regime. Maximizing this approximation of sum-rate leads us to the interference alignment method 
iTTTl . For frequency selective channels, interference alignment corresponds to correlated signalling across 
different frequency tones. This linear transceiver scheme for interference alignment is a generalization 
of the standard OFDMA scheme whereby each data stream is transmitted on a single subcarrier, which 
corresponds to using the standard unit basis vectors {e^} (the i-th standard unit vector) for transmit 
beamforming. The linear transceiver structure for interference alignment is more general since it does 
not require diagonal structure nor mutual orthogonality (two transmit covariance matrices X, Y are said 
to be orthogonal if Tr(XY) = 0). 

If we remove mutual orthogonality condition and impose only diagonal structure on transmit covariance 
matrices, then the interference management problem is reduced to the dynamic spectrum management 
problem B01 where the goal is to find the optimal power allocation (i.e., optimal diagonal transmit 
covariance matrices) which can maximize system throughput. This problem has recently been a topic 
of intensive research in the signal processing and communications communities. For diagonal matrix 
channel case (e.g. frequency selective scenario), the problem of maximizing sum-rate has been shown to 
be NP-hard ||4()1 . Several algorithms have been proposed which provide varied performance in different 
channel conditions. These include: Iterative Waterfilling Algorithm IWFA ll22l . Successive Convex Ap- 
proximation Low complExity (SCALE) algorithm (39), Autonomous Spectrum Balancing (ASB) |29l . 
Optimal Spectrum Balancing (OSB) |[24l . Furthermore, different algorithms are proposed for the case 
when the channel matrices are non-diagonal. Authors in ll23l . |[25l proposed IWFA based algorithms 
for power allocation. However, these selfish approaches work well only in low SNR cases or when the 
interference is low. 

Compared to the networked MIMO approach, interference alignment requires less information exchange 
among transmitters, and is therefore simpler to implement in practice. Recently two iterative algorithms 
have been proposed for interference alignment (2), RD . Both appear to work well in simulation of small 



IEEE TRANSACTIONS ON INFORMATION THEORY (SUBMITTED) 4 

systems (e.g., three users, each equipped with two antennas)[] These algorithms require system users 
to first specify the DoFs for all receivers and then attempt to achieve them by iteratively aligning the 
interferences. However, these algorithms can not check if a given tuple of DoF is achievable, nor is 
there any guarantee for reaching interference alignment even when the given tuple of DoF is achievable. 
Moreover, by focusing only on high SNR regime and interference alignment, these algorithms do not 
attempt any power allocations across different data streams. This can result in linear transceivers with 
suboptimal performance at low to intermediate SNRs. 

In this paper, we consider the problem of maximizing the sum of DoFs and the problem of checking 
if a given set of DoFs is achievable with linear transceivers. We study the complexity status of both 
of these problems over the spatial domain and establish their NP-hardness. These results suggest that 
the two existing algorithms for interference alignment 0, |4T1 cannot converge in general. We also 
propose a distributed algorithm to design linear transceivers for interference channels. Our approach 
is based on using MMSE receivers while optimizing transmit covariance matrices for all transmitters. 
We maximize the weighted sum of a utility of SINR's for each data stream and use iterative convex 
optimization/relaxation to compute a (local) optimal solution. The utility function is SINR/(1 + SINR) 
which converges to 1 when SINR — ► oo, and is proportional to SINR when the SINR value is small. 
In this way, maximizing the sum of utilities for all data streams corresponds to maximizing the total 
DoF when the noise vanishes. Simulations show that our algorithm performs well in all SNR regions 
and can deliver far superior sum-rate performance than the existing interference alignment algorithms of 
0, BTll . Compared to the networked MIMO approach which requires sharing of data streams, our linear 
transceiver design algorithm requires less information exchange: at each iteration, only small covariance 
matrices are exchanged, the size of which are proportional to the antenna numbers at each transmitter or 
receiver. 

II. System Model 

Consider a K-user MIMO interference channel with K transmitter - receiver pairs. Let be an 
Nk x Mj matrix representing the channel gain from transmitter j to receiver k, where Mj and iVj. denote 
the number of antennas at transmitter j and receiver k, respectively. The received signal at receiver k is 



'Even though the two algorithms were motivated from different perspectives, they are in fact algorithmically identical. 
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given by 

K 

where is an Mj x 1 random vector that represents the transmitted signal of user j and ~ M(0, a 2 I) 
is a zero mean additive white Gaussian noise. 

For practical considerations, we focus on optimal linear transmit and receive strategies that can maximize 
system throughput. In particular, suppose transmitter k uses a beamforming matrix Vfc to send the signal 
vector Sfc to its intended receiver k. At the receiver side, receiver k estimates the transmitted data vector 
Sfc by using a linear beamforming matrix U^, i.e., 

x fc = V fc s fc , s fc = Ufcyfc, 

where the data vector € C dfcXl is normalized so that ^[s^s^] = I, and is the estimate of at 
k-ih receiver. G i^M k xd k an( j jj k ^ ^N k xd k ar£ ^ beamforming matrices at the transmitter and the 
receiver of user k, respectively. 

It is known that the problem of designing optimal beamformers to maximize sum-rate of the system is 
NP-hard |40l even in the single transmit/receive antenna case. Notice that recent works IB, (2l suggest 
that the optimal strategy should have interference alignment structure in the high SNR regime. Therefore, 
we are led to find a linear transmission-reception strategy that can maximize the total degrees of freedom. 
In the next section, we provide the complexity analysis of this problem. 

III. NP-Hardness of Optimal Interference Alignment 

In this section, we show that for a given channel, not only the problem of finding the maximum DoF 
is NP-hard, but also the problem of checking the achievability of a given tuple of DoF, {d\, dx ), is 
NP-hard when there are at least 3 antennas at each node. 

Notice that the interference alignment conditions in the k-th receiver are 

UlHkjVj = 0, Vj ^ k, (1) 

rank (U^H fcfc V fc ) = d k . (2) 

The first equation guarantees that all the interference is in the subspace orthogonal to Uj. while the 
second one assures that the signal subspace H^V^ has dimension and is linearly independent of the 
interference subspace. 

In the sequel, we examine the solvability of above interference alignment problem (OQ) - (0 in two 
different cases. 
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S.t. 



UjjHjyV^O 



k = l,..,K, j^k 



rank (Uj[ H fcfc V fc ) = d k , k = l,..,K 



is NP-hard. Moreover, if each node is equipped with at least 3 antennas, then the problem of checking 
the achievability of a given tuple of DoF, (d\,d2, ■ ■ ■ ,dx), is also NP-hard. 

Proof: The proof of the first part is based on a polynomial time reduction from the maximum 
independent set problem which is known to be NP-complete. For a given arbitrary graph G = (V, E), 
where \V\ = K, consider a K user interference channel that each receiver and transmitter has a single 
antenna. Moreover, the channel coefficients are given by: 



It can be checked that the receiver nodes can only achieve a DoF of either or 1, and those receiver 
nodes achieving a DoF of 1 form an independent set in G. Thus, the problem of maximizing the total 
DoF for the above interference channel is equivalent to the problem of finding the maximum independent 
set of vertices in the graph G. 

In order to prove the second part we use a polynomial reduction from the 3-colorability problem. The 
latter problem is to determine whether the nodes of a graph can be assigned one of the three possible 
colors so that no two adjacent nodes are colored the same. The 3-colorability problem is known to be 
NP-Complete. There are two main steps in the construction. In the first step, some dummy nodes are 
added to the channel in order to force a discrete structure such that each non-dummy node may only 
have one of the three possible cases. The second step is to define the direct channels in order to make a 
polynomial reduction from the 3-colorability of an arbitrary graph to this problem. 

For an arbitrary graph G with N nodes, we will construct a special MIMO interference channel for 
which the achievability of one degree of freedom at each user is equivalent to the 3-colarability of G. 
In our construction, the MIMO interference channel will have two types of users: N main users, each 
equipped with 3 antennas at their transmitters and receivers and UN dummy users which will be defined 
later. Hence the total number of users is 12N. In the rest of the proof we suppose that each user (either 
the dummy user or the main user) wants to send one data stream. In other words we want to check if 
the tuple of all ones is achievable by the constructed interference channel or not. 
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We divide the dummy users into two groups. The number of dummy users in the first group is 2N 
and the number of dummy users in the second one is 9N. Each dummy user in the first group has 3 
antennas at its receiver and transmitter, while each dummy user in the second group has two antennas at 
its transmitter and receiver. Let us further arrange the 2N dummy users in the first group into /V subsets 
each containing two users. We denote these subsets as A%,i = 1, ...,N, \Ai\ = 2. We also denote the 
users in the set Ai as and dj.2, and associate them to the i-th main user. For notational consistency, 
we denote main user i as a^o- We will also use a^fcj to denote the j-th transmit antenna of user a^fc, 
where 1 < i < N, k = 0, 1, 2 and j = 1, 2, 3. Similarly, we partition the set of 9iV dummy users in the 
second group into N subsets B^i = 1,...,N, each containing exactly 9 dummy users denoted by b^, 
with £ = 1,..,9. Each of these 9 dummy users will have two receiving antennas which we denote as 
h,e,m, with m = 1,2. 

Now for any fixed i and j, we consider any size-2 subset of {<H,kj '■ k = 0, 1, 2}, e.g., {a^oj, a i,i,j}- 
For each fixed i and j, there are exactly 3 of these cardinality-2 subsets. Since there are 3 different 
choices of j, we have a total of 9 subsets of this kind for any fixed i. Let us index these 9 subsets by 
£, £ = 1, ..,9, and assign the ^-th subset to user in Bi. Now we define the links in the channel for 
the users in Ai and Bi. First, the channel matrices of all the direct links for any of the dummy users 
are I (where I is the identity matrix of the appropriate size). In addition, none of the dummy users in 
Bi (i = 1,2,..., iV) cause interference to the other users (which means that the channel gains between 
their transmit antennas and the other users' receive antennas are all zero). Now for the aforementioned 

^-th subset which we denote as S iti = {ai,k tl ,j ei ,aiM 2 ,jt 2 }> we c ° nnect a i,fe £l ,^ 1 and a iM 2 ji 2 to 
and to 6^2, respectively. Here by connecting a transmit antenna to a receive antenna we mean that the 
channel coefficient between these two antennas is 1. This situation is shown in the figure Q] for the case 
Si,i = {di,o,i, a i,l,i}- Furthermore, we assume that dummy users ctj^, k = 1,2 do not suffer from any 
interference. 

Suppose that user (k = 0,1,2) uses the transmit beamforming vector («t,A;,i> v i,k,2, t>i,fc,3)- Then 
the interference received at the dummy receiver of bn will be: 

^■h,e = i v i,ki 1 ,ji 1 Si,ki 1 ,'Vi j k l , 1 ,j e2 Si : k e2 ) (3) 

where is the signal user a^k intends to send. Notice that the signals which two different users want 
to transmit are statistically independent. As a consequence, if we want to have interference alignment at 
the receiver of b^g, so that this user can send its own data stream, it is necessary and sufficient to have 
v i,ki 1 ,je 1 v i,ke 2 ,je 2 = 0. Hence, having the interference alignment at ^ for all £ = 1, .., 9 is equivalent 
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Fig. 1: Channels to the dummy receiver 



to the fact that users ai^,k = 0,1,2 cannot send their messages through the antennas with the same 
index, simultaneously. For example, if Uio,i 7^ then i and Ui,2,i have to be zero. On the other 
hand, considering the fact that each user needs to send one data stream, it follows that none of the users 
k = 0, 1,2, can send their message on two of their antennas simultaneously, because otherwise if 
for example a^o sends its message on two antennas, then it would result in insufficient spatial dimension 
for either a^i or a^- 

As an immediate consequence of these two facts we have just mentioned, we can conclude that the 
transmit beamforming vector at each user di : k,k = 0,1,2, must be proportional to one of the vectors 
[1,0, 0] T , [0, 1, 0] T or [0, 0, 1] T . This is true specially for the main user i. As we are not concerned about 
the constant factors, we have successfully imposed a discrete structure on the problem solution so far. 
Notice that each dummy user bi t t has a total of 2 dimensions in its receiver. Since we have aligned 
the interference at each dummy user ba, these users can communicate their data streams easily along 
the remaining dimension left for them in their receivers and remove interference which lies in the other 
dimension. Moreover, since in our construction the dummy users a^, k = 1,2 do not experience any 
interference from other users and their direct channel is I, so these users can easily achieve one degree 
of freedom. Thus, we only need to take care of the main users. 

For each of the N main users, we must pick one of the three transmit beamforming vectors [1,0, 0] T , 
[0, 1, 0] T or [0, 0, 1] T in order to achieve interference alignment at all the main receivers. We suppose all 
the direct channels for the main users, Ha, are I. For the cross channels, we use the structure of graph 
G = (V,E). For each edge in G, we set = Hj, = I. Otherwise we set = Hjj = (zero 
matrix of appropriate size). Consequently, the main users i and j interfere with each other if and only if 
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they are connected to each other in graph G. We claim that achieving interference alignment in the above 
MIMO interference channel is equivalent to 3-colorability of graph G. This is because each user can 
choose 3 possible beamforming vectors, each corresponding to a different color. If main user i chooses 
one of the three possible beamforming vectors (or one of the three colors), then this beamforming vector 
cannot be chosen by any other main users adjacent to the main user i in the graph G, otherwise the 
interference would appear in the desired signal space at the receiver of main user i. This establishes the 
equivalence between the 3-colorability of G and the achievability of one degree of freedom for each user 
in the constructed MIMO interference channel. Since 3-colorability problem is NP-hard, it follows that 
the problem of checking the feasibility of interference alignment is also NP-hard. ■ 
Theorem Q] shows that the problem of checking the achievability of a given tuple of DoF is NP-hard if 
all users (or at least a constant fraction of them) are equipped with at least three antennas. Our next result 
shows that when each user is equipped with no more than two antennas, the same problem can be solved 
in polynomial time. To this end, we need to define some notations and make some observations. First of 
all, the interference alignment problem is equivalent to finding the signal subspaces at the transmitters and 
the interference subspaces at the receivers such that the interference alignment conditions are satisfied, 
i.e., 

d k = dim(<S fc ) 

H kk S k _L X k 

H kj Sj C l k Vj ^ k, 

where S k and X k denote the signal subspace at the transmitter k and the interference subspace at 
receiver k, respectively. The operator _L represents the linear independence of two subspaces. The 
first condition implies that the signal space has dimension d k while the second condition says that 
the interference subspace and the received signal subspace must be linearly independent. Finally, the 
third condition assures that the interference from other users lies in the interference subspace (which is 
linearly independent of the signal subspace). 

Notice that in the 2-antenna case, if dj = d k = 1 and rank(Hfcj) = 2, and the interference subspace 
X k is known, then Sj can be uniquely determined by Sj = HLlj, for any j ^ k. Conversely, if Sj is 
known, we can uniquely find the interference subspace of user k, i.e., Z k = H k jSj. Thus, by starting 
from a node with a known subspace and traversing the interference links with full rank channel matrices, 
we can uniquely determine the signal subspaces in the transmitter sides and the interference subspaces at 
the receiver sides as long as they all have one DoF. Furthermore, if we find a loop of full rank interfering 
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links, the signal subspaces at these nodes must be the eigenvector of the composite channel matrix of 
the corresponding loop. To make this point clear, consider a 4-user interference channel. If all interfering 
links are full rank, by starting from transmitter 1 and use the loop Txl — > Rx2 — > Tx3 — > Rx4 — > Txl, 
we have the following relations 

X2 = H2i<Si, S3 = H 23 1 l2, Z4 = H4353, S\ = H^Z^. 

Thus, S\ must be the eigenvector of the loop channel matrix HJ-l H43H23 H21. Using this observation and 
the idea of traversing the full rank interfering channel links, we can establish the polynomial solvability 
of the problem of checking the achievability of a given tuple of DoF. 

Theorem 2 For a K-user MIMO interference channel where each transmit/receive node is equipped with 
at most two antennas, the problem of checking the achievability of a given tuple of DoF is polynomial 
time solvable. 

Proof: By assigning zero channel weight if necessary, we can assume without loss of generality 
that all transmitters/receivers are equipped with exactly two antennas, i.e., M\, = Nk = 2, for all 
k = 1,2,- •• , K. Furthermore, notice that if a user has zero DoF (dk = 0), then we can assign the 
zero beamforming vector to this user and remove it (both its transmitter and receiver) from the system. 
Thus, we can assume 1 < dk < 2 for all k = 1, 2, • • • , K. We further assume that all the direct channel 
matrices H^, k = 1, 2, . . . , K, are nonzero. Now the problem is to determine whether the given tuple of 
DoF (e?i, di-, ■ ■ ■ , dx) is achievable or not. To this end, we need to define two bipartite graphs over the 
nodes of the interference channel (one side of the graph consists of transmit nodes and the other consists 
of the receive nodes). In particular, we construct a bipartite graph G by connecting the transmit node of 
user i to the receive node of user j if and only if the channel between them is nonzero, i.e., Hjj ^ 0. 
Furthermore, we construct a bipartite subgraph G' = (V', E') of G by considering only the full rank 
links of G, i.e., connecting transmit node i to the receive node j ^ i if and only if rank(Hjj) = 2. Notice 
that the link between transmit node i and receive node i is not included in G' even if rank(Hjj) = 2. 

In what follows, we first consider a simple case which gives us the idea of how a loop of rank 2 
interfering channels forces a discrete structure on the choice of signaling subspaces at the transmitters. 
Then, using this idea, we provide the proof for the general case. 

Consider a connected component H of G where all the interfering links are full rank and connected, 
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i.e., the induced subgraph of H over G' is connected and contains all the interfering links of H. We first 
argue that H can not contain the receive node of any user k with dk = 2. Suppose the contrary. Then the 
direct channel matrix, Hkk, must be full rank. [If H^k is rank deficient, then the received signal subspace 
at receiver k has dimension at most 1, which would make it impossible to achieve dk = 2.] We further 
claim that H cannot contain any other nodes. Since the direct link between the transmit and receive 
nodes of user k is not contained in H, it follows that the receive node of user k must be connected to 
another transmit node a in H. Let this node a be associated with a user j (j ^ k). Notice that user j 
achieves a DoF at least 1 (since all zero DoF users have been removed from G). By definition, node a 
must be connected to the receive node of user k via a full rank cross talk channel matrix Hjy. Thus, user 
j will cause a nonzero interference subspace to user k, contradicting dk = 2. Since all users with DoF 
=0 has been removed from graph G, we must have c% = 1 for all receive nodes in H. For the other case 
where node a is a receive node of user j, then a is linked to the transmit node of user k via a full rank 
channel matrix. In this case, user k will cause a 2-dimensional interference subspace to user j, making 
it impossible to have dj > 1. 

We now assume that all receive nodes in H have one DoF. We can start from an arbitrary initial node 
of H and use Breadth First Search (BFS) to find a spanning tree. Since each user has one DoF, the signal 
and interference spaces of all receive nodes in H are uniquely determined by the signal (or interference) 
space of the initial node. Since the initial node is arbitrary, this shows that the signal/interference spaces 
for all nodes in H are linearly related to each other (via some constant composite channel matrices, 
see the discussion before Theorem 2). Fixing any one uniquely determines the rest. For the remaining 
edges (or links) not in the spanning tree, they each create a unique loop in the tree. We can compute 
the composite channel matrices for these loops (see the discussion before Theorem [2]). Notice that each 
loop matrix (size 2x2) has either one, two or infinitely many eigenvectors (when the composite channel 
matrix is a constant multiple of identity matrix). Suppose a loop matrix (starting from a given transmit 
node, say 6, in the loop) has one or two unique eigenvectors, then the signal space of node b must 
be generated by one of these eigenvectors. In fact, since the beamforming vectors of nodes in H are 
linearly related, each loop in H places a restriction on the choice of beamforming vector of node b. 
Thus, for any fixed transmit node b in H, there are multiple restriction sets, each corresponding to a 
loop in H caused by adding an edge to the minimum spanning tree and each containing one/two one- 
dimensional subspaces from which node 6's signal space can be chosen. The receive nodes in H can 
achieve interference alignment if and only if these restricted sets of one-dimensional signal subspaces 
for node b share a common one-dimensional subspace. Moreover, to ensure each user in H achieves one 
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DoF, we need to additionally make sure that the resulting interference subspaces at all receive nodes in 
H are linearly independent from the corresponding respective signal subspaces. Since the total number of 
restriction sets is at most linear in the number of edges in H and each restriction set contains at most two 
one-dimensional subspaces, checking if these restrictions have any common one-dimensional subspace 
can be carried out in 0(K 2 ) time. Moreover, for each common one-dimensional subspace, checking if 
the linear independence between the resulting signal subspace and interference subspace (already aligned) 
at each receive node can also be performed in time that is linear in the number of nodes in H, or in 
O(K) time. 

Now we are ready to look into the general case in which the rank 1 links are considered as well 
as the full rank links. Since there is no interfering link between different connected components of G, 
we can assign the signal subspace for each connected component separately. Notice that the number of 
connected components of G is at most K, we only need to assign transmit subspaces for every connected 
component of G in polynomial time. 

Let H be a connected component of G. Let H' C G' be a subgraph of H which contains only links 
with full rank channel matrices. H' can be decomposed into various connected components of G' . By 
the argument above for such components, the signal/interference spaces for the nodes in these connected 
components (consisting of at least two nodes) can be assigned in one of the two ways: 
(Bl) The connected component contains a cycle with a channel matrix that is not equal to a constant 
multiple of the identity matrix. In the case, the beamforming vectors of all nodes can be determined 
from the eigenvector(s) of a certain loop channel matrix. In this case, there are at most two possible 
choices of signal/interference space for each node. 
(B2) The connected component has no loops (i.e., forms a tree) or if every loop has a composite channel 
matrix that is a constant multiple of the identity matrix. In this case, the signal/interference spaces 
of all nodes are linearly related to one another. The signal/interference space of one node can be 
fixed at an arbitrary one-dimensional subspace. Once this is fixed, the signal/interference spaces of 
other nodes can be derived uniquely. 
Consider a rank-1 interfering link in H with channel matrix Hy (i ^ j). If user j transmits in the null 
of Hjj, then the signalling subspace of user j is known, i.e., Sj = Null(Hij). Otherwise, the interference 
subspace at user i is known, i.e., Zj = Range(Hij). This is because > 1, so we have dimZj < 1. 
This plus the fact that Range(Hij) C Zj implies Zj = Range(Hij). Therefore, we can assign a Boolean 
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variable x^ to each rank-1 channel Hjj, with "xij = 1" representing Sj = Null(Hij) and "x^ = 0" 
signifying 2j = Range(Hij). In this way, we associate a Boolean variable x^ for each rank-1 crosstalk 
channel matrix in H. 

Next we represent the interference alignment condition at each receive node of H using the Boolean 
variables {x^} (plus some auxiliary Boolean variables {yi,Zij,Zi} defined below). Suppose user i's 
receive node is in H. We consider the cases di = 2 and di = 1 separately. 

Case di = 2: In this case X, = 0, so we must have = 1. We rewrite this condition in the form of 
two 2-SAT clauses 

Xij V y i} x^ V y u for all j ^ i and rank(Hy) = 1, (4) 

where y« is an auxiliary Boolean variable. In this case, the satisfaction of I® and the condition that the 
receive node of user i is not connected to other users' transmit nodes via rank-2 links is equivalent to 
achieving one DoF for user i. 

Case di = 1 and rank(Hjj) = 1: In this case, then the received signal subspace is H-aSi = Range(Ha) 
and dimZj = 1, so that all the interference at the receive node of user i must be aligned in an one- 
dimensional subspace that is linearly independent of Range (Ha). We need to further consider several 
subcases, depending on if the receive node of user i is connected to other transmit nodes via rank-1 or 
rank-2 links. In particular, if the transmit nodes of users j and k are connected to receive node i via 
rank-1 links, then the interference alignment condition requires the satisfaction of the following 2-SAT 
clauses 

Xij V Xik, for all j ^ k ^ i such that rank(Hjj) = rank(Hjfc) = 1 and Range(Hij) ^ Range (Hjfc), 
Xij V Zij, Xij V Zij, for all j ^ i such that rank(H,;j) = 1 and Range(Hij) = Range(H.u), 

(5) 

where z-ij is a dummy Boolean variable, and the last condition corresponds to the linear independence 
requirement of the signal/interference subspaces. Moreover, if there is a rank-2 link connecting the receive 
node of user i to the transmit node of user £, t ^ i, i.e., is full rank, then the receive node of user i 
is in H' . Consequently, the transmit strategy of user i has only two possibilities Bl and B2 as outlined 
above. For the Case B 1 where the transmit node of user i can pick one of the two possible beamforming 
vectors v°, v], we define a Boolean variable with "z£ = 0" representing v° is chosen, while "z^ = 1" 
signifying is chosen. Now the interference alignment for user i requires the satisfaction of following 
2-SAT clauses 

Z£ V x^, for all j ^ t ^ i such that rank(Hjj) = 1, rank(H^) = 2 and H^v° Range(Hij), 

(6) 

zi V x^, for all j ^ £ ^ i such that rank(Hjj) = 1, rank(H^) = 2 and H^vi Range(Hij). 
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If in Case Bl the transmit node of user I must pick a unique vector y\, then we must have zg = and 
= 1 if H,^v° Range(Hij), and zg = if H^v$ G Range(Hij). The latter conditions are equivalent 
to the satisfaction of the following 2-SAT clauses: 

z~£ V x^, zg V Xij, Z£ V x^, for all j 7^ £ 7^ i s.t. rank(Hjj) = 1, rank(H^) = 2 and H^v^ Range(Hij), 

Z£ V x,,j, V Xjj, for all j 7^ £ 7^ i s.t. rank(Hjj) = 1, rank(H^) = 2 and H.^v° G Range(Hij). 

(V) 

To ensure linear independence of the signal and interference subspaces for user i, we must make sure 
the satisfaction of the following 2-SAT clauses 

z.£ V yi, zi V yi, for all £ 7^ i s.t. rank(H^) = 2 and H^v] £ 7?ange(Hii), 

(8) 

V yj, 2^ V yj, for all £ 7^ z s.t. rank(Hi^) = 2 and H^v° G Range{H.u), 
where yi is a dummy Boolean variable. Now we consider Case B2. Suppose the receive node of user i 
lies in a connected component H" of H' . Then, for each pair of receive node of users i and £ in H" 
(i 7^ £), there exists a (efficiently computable) nonsingular matrix Gu such that 

^i = Gal£. 

To ensure this condition, the following 2-SAT clauses must be satisfied for all transmit nodes j and k in 
H": 

Xij V X£k, for all j ^ i, k ^ £ s.t. rank(H^) = rank(Hij) = 1, and Gi£Range(H.£k) 7^ Range(Hij). 

(9) 

Furthermore, to make sure that the signal and interference subspaces are linearly independent at the 
receive node of user i, we must have for all transmit node j in H" that the following 2-SAT clauses are 
satisfied 

x^ V Zij, x^ V Zij, for all j 7^ i s.t. Range(Hij) = Range(Ha). (10) 

Finally, we notice that the Boolean variables {x^, z^} all represent the signaling strategies of user £. We 
must ensure that these signaling strategies are compatible. In other words, we can not simultaneously 
have both Sg = Null(Hi£) and S£ = Null(Hj£) (j 7^ i), unless of course the two null spaces are equal. 
This implies that we should have 

xu V Xj£, for alH 7^ j 7^ £ s.t. rank(H^) = rank(H^) = 1, AW/(H^) 7^ Null(H.ji). (11) 

Moreover, if the transmit node of user £ is also in H" and its transmit beamforming vector must be 
chosen from the set {v°, \j} (Case Bl). Then, by a similar argument, we must also ensure the following 
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compatibility conditions: 

aii£ V Z£, for all i 7^ j 7^ £ s.t. rank(Hj£) = 1, rank(H^) = 2, v° g" Null(Hj£), 

(12) 

V z^, for all i 7^ j 7^ £ s.t. rank(H^) = 1, rank(Hj^) = 2, g" Null(Ha). 
In case of B2 (i.e., iJ" is a tree or all loop matrices are constant multiples of identity matrix), then the 
transmit subspace of user £ (which lies in H") can be chosen continuously (rather than from a discrete set 
{\° £ , v^ 1 }). In this case, the compatibility condition (fTTb is sufficient; there is no additional compatibility 
condition needed. 

Case di = 1 and rank(Hjj) = 2: In this case, if the transmit node of user i is connected to a receive 
node of user j via a rank-1 link, then Xji = 1 signifies the use of transmit beamforming subspace of 
Null(Hji) for user i; else if transmitter i is in H" so that its transmit beamforming direction must be 
chosen from v°, v|, corresponding to z\ = and 1 respectively (Case Bl). [Case B2 corresponds to the 
continuous selection of beamforming vector for user i; no 2-SAT clause is needed in that case.] In the 
first case, the signal subspace at receive node of user i becomes HaNull(Hji), while in the second case, 
the signal subspace is HjjV°, or Ha\}. We must make sure the signal subspace is linearly independent 
from the interference subspace of user i. This implies that the following 2-SAT clauses must be satisfied: 

xji V xa, for all i 7^ j 7^ £ s.t. rank(H^) = rank(H«) = 1, Range(H.n) = HuNull(H.ji), 
xn V Zi, for all i 7^ j s.t. rank(H^) = 1, i G H", HjjV? € Range^Hn), (13) 
xu V z\, for all i 7^ j 7^ £ s.t. rank(H^) = 1, i G H" , Hu\} G Range(Hii). 
It can be checked that the DoF tuple (d\,d2, ■ ■ ■ , dx) is achievable if and only if conditions d4T>-dT3l) 
are satisfied for some binary realizations of Boolean variables {xij, yi, Zi, Zy}. Moreover, the number of 
such 2-SAT clauses is polynomial in K (in fact 0(K 4 )). Hence, we have transformed the DoF feasibility 
problem in polynomial time to an instance of 2-satisfiability problem. The latter problem is known to be 
solvable in polynomial time. ■ 

IV. Strategies for Linear Transceiver Design 

In this section, we propose linear transceiver design algorithms for interference channels. Using linear 
transceivers introduced in Section dH the estimated data stream at receiver k is given by 

K 

Sfc = u fc XI Hfc i V i s i + U fc nfc 

j'=i 

and the SINR value for the q-th data stream of user k, 7^, is given by 
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where u? and denote the q-th column of and respectively. Using a linear MMSE receiver 
u q k , we have 

7 fc 9 = vfHL(a 2 I+ H^vfH^" 1 !^. 

One possible choice of the utility function for the k-th user could be the sum of the SINR values of its 
data streams, i.e., 

= £vfH^ 2 I+ £ H^vfH^r 1 !^. 

However, maximizing does not lead to the maximization of the total DoF in high SNR. Therefore, we 
need to introduce another utility function in order to capture more DoF for each user. First, we define 
= iqib as me utility function of the q-th data stream of user k and then, we consider Uk = Yl q ^(7fc) 
as the utility function of user k. Thus, at high SNR, Uk equals the DoF at receiver k, while at low SNR, 
Uk equals the sum SINR. Using the rank one update of the matrix inverse term in SINR value, we can 
rewrite Uk as 

Uk = £ vf Hf fe (a 2 I + £ Hyvjvf H*)" 1 !!^. 

1 (J,r) 

The proposed utility function preserves fairness among different data streams of user k and also closely 
approximates the sum DoF at high SNR. 

Directly optimizing linear transceivers U^'s and V^'s requires specification of DoFs dk in advance, 
since the dimension of Ufc and depends on dk- To avoid this explicit dependence on dk, we consider 
optimizing the transmit covariance matrix instead of linear transceivers and V^. In particular, we 
write the utility function of user k as 



U k = Tr 



HfcfeQfcH^.((T 2 I + Yj Hj^Q^H 



le) 



£=1 



(14) 



where = J2 q v^(v^) T is the transmit covariance matrix of the k-th user. However, this utility function 
still does not related to the sum-rate directly. In the sequel, we propose a weighting approach to relate 
the utility function in (fT4l to the rate of user k. 

Consider the well-known weighted sum-rate maximization problem 

K 

max > o-kRk (15) 
{Oaf . ^ 

s.t. Tr(Q k ) < Pk, Qfc > 
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where R k = log det ^1 + Hfc/ c QfcH| fc (<r 2 I + Yle^k HjwQ^H^) -1 J is the achievable rate of user k and 
the coefficient a k denotes user A;'s weight. Using linear algebra to simplify the objective function, the 
above problem can be reformulated as the following equivalent optimization problem: 



min a k lo S det [ I - H fcfc Q fc H^ fc (a 2 I + ^ H W Q*E&] 

■ Jfc}fc=1 k=i \ \ i=\ J , 



{Q4f= 

s.t. Tr(Q fe ) < p k , Q fc 0, 



(16) 



where the term inside the determinant is linearly related to the utility function in (fl~4l ). Similar to [51], 
we reformulate the problem ( fl~6l ) by further introducing new optimization variables 6 W MxM , k = 
1,2, . . . , K, to obtain the following equivalent optimization problem 



K K 

min V" a k Tr(W k g k (Q)) - V* a k log det W k 

s.t. Tr(Q fc ) <Pk Qk> 0, 
where Q = (Qi, Q 2 , . . . , Qk) and 

K 

g k (Q) 4 I - H fcfc Q fc H^ fc (a 2 I + ]T H^Q^H^)- 1 . 



(17) 



The optimization problem (fTTl ) is convex in {W^}]^. By checking the first order optimality condition, 
the optimal W k is given by 

Wf =I + H tt Q t 4( ( r 2 I + ^H M Q < 4)- 1 1 V k = l,2,...,K. (18) 

By plugging back the optimal W^ p< in (fTTl ). we immediately see the equivalence of (fTTl) and (fT6l ). 
Furthermore, in order to have a distributed approach, we let users update their transmit covariance matrix 
independently. Therefore, for fixed {W k }£ =l , user k can solve the following optimization problem to 
update its transmit covariance matrix: 

K 

W k U kk Q k Ul k (a 2 I + £ H^Q.H^)" 1 



max at TV 
Q fc 



1=1 



K 



WjH^-QjHj^ff 2 ! + £ H^Q.Hj,)- 1 



(19) 



s.t. Tr(Q fc ) < p fe Q fc > 0. 



Unfortunately, this objective function is not convex. In order to make the problem convex, we keep 
the first term in the objective function (which is a concave function of Q k ) and use the local linear 



IEEE TRANSACTIONS ON INFORMATION THEORY (SUBMITTED) 



18 



approximation of the second term, i.e., 

E «i Tr [ W i H iiQi H S( C i^ + H^QfcHj)" 1 ] 

« E ^ Tr { w i H «Qi H Ji [(Ci* + H^QfcHjfc)- 1 

— (Cjfc + HjfcQfcHj fc )~ 1 HjfcQ/ {; Hj fc (Cjfc + HjfcQfcHj fc ) _1 
+ (Cjfc + Hj k Q k Hj k ) 1 Hj fc Q fc Hj fc (Cj / ! C + HjfeQfcHj^) 1 | 

where Q k is the local value of transmit covariance matrix at the previous iteration and Cj k is the received 
signal covariance matrix at receiver j excluding the k-th user's signal, i.e., 

C jk 4 a 2 I + E H^Q^Hj. (20) 
By substituting the above approximation in (fT9l ) and simplifying the resulting optimization problem, we 



get 



max a k Tr 



K 



Tr [B fc Q fe ] 



(21) 



WfeHfcfeQA,.Hf fc ((T 2 I + E Hfe«QfH^) 1 

i=i 

s.t. Tr(Q fc ) < Pk Q k )? 
where 15, 4 £ j?4fc HT fc (C jfc . 1 1 , Q, TT; a ; n ; \V ll^ll^CU | II Q;, TT'. ) H ;i . The objective 



function in (12Tb considers the effect of transmit covariance matrix of user k on not only its own rate, 
but also those of others in the interference channel. Similar balanced approaches have been considered 
in related works, see ||42ft , ||52"1 - ||541 . By further simplification of the objective function and using the 
Schur complement, the problem can be formulated as the following Semi-definite Programming (SDP) 
form: 



min a fc Tr [Y] + Tr [B k Q k ] 

Qk ,Y 

s.t. Tr(Q k )< Pk , Q fc ^=0, 



Cfcfc + iL kk Q k H kk (W fc Cfcfc 



(22) 



|V2 



(w fc c 



kk 



|V2 



0. 



Note that the matrices W k and C kk are updated by (1181) and (1201) respectively. Thus W^Cfefc is Hermitian 
positive semi-definite. Hence, for fixed matrices {W k }£ =l , user k can update its transmit covariance 
matrix Q k by solving the above SDP problem. 

Note that the second term in ( fT9l ) is a convex function of Q^. Therefore, the local linear approximation 
is a lower bound which is tight at the current point Q^. Hence, by solving (l22l . we minimize a concave 
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1 

1. 


initialize with Qfc = and Wfc = 1, tor all k = 1, 2, • • 




2. 


repeat 




3. 


tor k = 1, 2, • • • , iv do 




4. 


J 4- 1TS7 J" j. ill OL 

update Wfc according to dl8D 




5. 
6. 


update Qfc by solving (l22l) 
update Wfc according to (fT8T) 




7. 


until convergence, or Q — Q < e 





Fig. 2: An iterative SDP approximation algorithm for sum-rate maximization 



lower bound of the original utility function (fl9l ). Since the previous iterate Qfc is feasible for (fl9l ). it 
follows that the system utility function (i.e., the objective function of (fl9l )) is non-decreasing. Furthermore, 
(fl9l ) is bounded from above and this implies the sequence of objective function values generated by the 
proposed algorithm converges. The following theorem further establishes the iterate convergence to a 
stationary point for the proposed algorithm. In order to prove that each limit point of this algorithm is a 
stationary point of the original problem we need the following lemma. 



TV [BfcQfc] (23) 



Lemma 1 If the direct channel matrices are full-rank and tall, the function: 

K 

hk-i(Qk) = a k Tr WfcHfcfcQfcH^(<7 2 I + ^Hfc.Q.H^)" 1 

l=i 

is strictly concave with respect to symmetric positive semidefinite matrix Qfc. Moreover, the objective 
function of (1171 ) is also strictly convex with respect to Wfc. 

Proof: See Appendix, Section [VI] ■ 

Theorem 3 Assuming that the direct channel matrices, Hfcfc, are full rank and tall, then every limit point 
of the proposed algorithm is a stationary point of (I15I ). 

Proof: According to Lemma |2] (see Appendix, section IVTb . every stationary point of (fTTT ) is also 
a stationary point of (fT5T ). Therefore, we only need to prove that every limit point of the proposed 
algorithm is a stationary point of (fTTT ). To this end, let us define the auxiliary variable X 1 = {X^}^, 
where X^^ = Q fc is the updated transmit covariance matrix of user k at i-th iteration and X^ = W fc 
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is the updated weight matrix of user k at i-th iteration. In particular, we define Q^, to be the solution of 
the following problem 

X 2fc-i = Qfc — Argmax f2k-i{Qk', X^Xg, . . . ,X l 2k _ 2 ,X l 2k 1 _ 1 ,X.' l 2k 1 , . . . , X^ 1 ) 

s.t. Tr(Q fc ) < Pk , Q fc )p 

where fak-iiQk'i X|, X|, • • . , X. 2k _ 2 , 'X.^le-v X^ , . . . , X^ ) is the objective function of (1211) which is 
the local concave lower bound approximation of the objective function in ( fT71) as discussed in section 
HVl Similarly, we define X. l 2k = Wl to be the updated weight matrix of user k at iteration i, i.e., 

*2k = ™l ± Argmax /(W fe ; X\, X* , . . . , X^, X^, X^\ . . . , X^ 1 ) 

where /(•; •) is the objective function in ( fTTl ). 

Let X* = (X\,~K 2 , . . . , ~X-2k) b e tne tuple of transmit covariance-weight matrices and X* be a limit 
point of the sequence {X l }^ 1 . Therefore, there exists a subsequence of indices {ii, %2, —, ij, ...} such 
that 

lim X^ = X* 

j->oo 

First, we will prove that lim X/ — X X J = by using contradiction. Suppose the contrary. Hence, by 

j-s>oo 

further restricting to a subsequence if necessary, we have 

37* > such that j ij > 7*, Vj, 

where j lj = ||X^ +1 — X^||. Let = ^—^7^-- Since ||S^|| = 1, according to Bolzano-Weierstrass 
theorem, there exists a subset of indices, denoted by /, and a unit length matrix S\ such that 

lim = s;. 

Obviously, < £7* < j lj for every e, < e < 1. Moreover, since the feasible set is convex, X^ + e7*S^ 

i +1 

belongs to the feasible set. Therefore, according to the definition of X^ and using the concavity of 
/1, we have 

/i(X*' +1 ; X^ ) > h{^{ + ; X*) > A(Xj ; X* ). (24) 

On the other hand, the value of the objective function in (fTTl) is always increasing and bounded from 
above. Moreover, the feasible set is closed and therefore X* is in the feasible set. Hence, the value of 
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objective function converges to /(X*), i.e., 



lim A(X?;X^) = lim / 1 (X? +1 ;X i = /(X*). 



Therefore, letting j — > oo with ij € / in (124|) yields 

/i(XJ + e 7 *Sl; X*) = /(X*), V e 6 [0, 1], 
which contradicts the strict concavity of /i(-) (c.f. Lemma [[J. Therefore, lim X^ -1-1 — Xv 



equivalently, we have 



lim X* J+1 = lim X* J = Xj. 



j-s-oo 



j->oo 



0, or 



(25) 



On the other hand, X^ -1-1 is the local maximum of /i(-,X* J ). Hence, 



VxJi(X^ +1 ;X^;f (X x -X 1 /) 



Tr 



for any feasible point Xi. Letting j — > oo and using (1251) yield 



<0, 



Tr 



V Xl /i(X^;X*) T (X 1 -Xt) 



< 0. 



Since /(•) and /i(-,X*) have the same gradient with respect to XJ at point X*, it follows that 



Tr 



VxJ(X*) T (X!-Xt 



< 0. 



Repeating the same argument for all k = 1, 2, ... , 2K, we get 



Tr 



V x J(X*) T (X fc -X£) 



<0, Vfc = l,2,..., 



2K 



By summing up all the equations for all fc's we get, 



Tr 



v x /(x*) T (x-x*; 



< 



which implies the stationarity of X*. ■ 
A couple of remarks are in order. First, in the proof of Theorem|3] we have only used the strict concavity 
of function /(•). Consequently, the proof works for other objective functions that have the same property 
and using similar methods, e.g. EH. Second, after solving (l22l to get the solution Q£, we can update 
the transmit covariance matrix by using relaxation parameter < a < 1, i.e., Q fc < — aQl + (1 — a)Qk- It 
can be shown that the convergence result of Theorem [3] holds even by using a fixed relaxation parameter. 



IEEE TRANSACTIONS ON INFORMATION THEORY (SUBMITTED) 



22 



An alternative to solving (1221 at each iteration is to update the transmit covariance matrix in a totally 
unselfish manner, i.e., solving the following problem 



The above problem has a closed form solution = p^qq T , where q is the eigen vector of B^. 
corresponding to its minimum eigen value. This unselfish approach requires all the users to exhaust 
all their transmit power, potentially causing unnecessary interference. Furthermore, it results in one DoF 
for each user because is always rank one. In cases that the all one DoF vector is not appropriate 
either because it is not achievable or because it is too conservative, the above unselfish strategy cannot 
lead to the maximization of sum DoFs. 

In general, if we know the DoF of each user a-priori and allocate equal power across the data streams, 
we can update the transmit beamformer of user k by solving the following optimization problem: 



This approach lets each transmitter use maximum power and pick a transmit covariance matrix V*. so 
as to minimize the total interference to other users. It has a closed form solution Vfc whose columns are 
proportional to the eigenvectors of corresponding to its dk smallest eigen values, scaled appropriately 
to satisfy the power budget constraint. 



min TrfBfcQfc] 



s.t. Tr(Q fc ) = p k 



Qk > o. 



(26) 




(27) 




1 



initialize with = and = I, for all k = 1, 2, • • ■ 



K 



2 



repeat 



4 



3 



for k = 1,2, ••• ,K do 
update Vfc by solving (T27T ) 



5 



update Wfc according to (TT~8T > 



6 



until convergence 



Fig. 3: The unselfish algorithm for sum DoF maximization 
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V. Simulation Results 

In this section, we present some numerical results comparing the Decentralized Interference Alignment 
(DIA) method JH with our proposed methods. All numerical results are averaged over 20 channel 
realizations. In each channel realization, the path loss of the channel coefficients are generated by a 
relay-backhaul model provided by Huawei Technologies. We consider 19-hexagonal wrap-around cell 
layout. We randomly choose K base stations, each serving a random relay in its own cell at each time 
slot. Each base station serves different relays in its own cell orthogonally. Therefore, at each time slot, 
the base station-relays form an interference channel. The relays have fixed locations so the the system has 
enough time to learn the channels. The MIMO channel coefficients are modeled by the standard single 
tap Rayleigh fading model. We consider linear MMSE receivers and equal power budget for all users 
and for all methods. To implement DIA, we need to predetermine DoF for all users. In all simulations 
DoFs are set to be equal for all users. 

In the first numerical experiment, we consider K = 10 base station-relay pairs, each equipped with 
M = 2 antennas. The predetermined degrees of freedom used in DIA method are d\ = d,2 = ■ ■ ■ = dx = 
d = 1. Figure [4] represents the sum-rate comparison between the proposed methods and DIA. As Figure 
@] shows, the proposed method yields substantially higher sum-rates in this case. In fact, the sum-rate 
achieved by the DIA method does not grow linearly with SNR, indicating that interference alignment 
has not been achieved. 



4> 
3 — 



^ - Distributed Interference Alignment 

— Unselfish 

SDP Relaxation 

— Selfish Approach 




10 15 20 

SNR(dB) 



Fig. 4: Sum-rate vs. SNR: K = 10, M = 2, d = 1 



It is known that the DIA method works well for the K = 3 case where interference alignment is 
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possible [0. We consider the case of K = 3 transceiver pairs each equipped with M = 3 antennas 
and one DoF is considered for each transmitter. As can be seen in Fig. [5j the selfish and the SDP 
approach works well in low SNR, but is outperformed by the DIA approach in high SNR region where 
the interference alignment effect begins to kick in. Interestingly, our Unselfish approach for interference 
alignment outperforms the DIA algorithm in the entire practical SNR range. Although the DIA method 
and the Unselfish approach both achieve a sum-rate that increases linearly with SNR, the Unselfish 
approach has a better offset compared to the DIA method. 



45 r 




5> 



, 1 i 1 i 1 1 

5 10 15 20 25 30 

SNR(dB) 



Fig. 5: Sum-rate vs. SNR: K = 4,M = 3,d= 1 



VI. Appendix: Proof of Lemmas [Hand [2] 



Lemma 1 If the direct channel matrices are full-rank and tall, the function: 

K 

W fc H fcfc Q fc H^Vl + HwQ/H^)" 1 



/2fc-l(Qfc) - "fcTr 



l=i 



Tr [BfcQfc] 



(28) 



is strictly concave with respect to symmetric positive semidefinite matrix Q^. Moreover, the objective 
function of (1171 ) is also strictly convex with respect to W^. 

Proof: Using the notations we have defined so far, /2fc-i(Qfc) is given by 

/2fc-i(Qfc) = ot k [Tr (W k C kk (C kk + HfcfcQfcH^)" 1 ) - Tr(B fc Q fe )] . 

The second term in fak-iiQk) i s linear in and does not change the strict concavity of the function. 
Hence, it suffices to show the strict concavity of Tr (~W k C kk (C kk + H^fcQfcH^,) -1 ). To do so, it is 
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enough to prove that the function is strictly concave in any feasible direction. We drop the index k 
for notational simplicity. Let us consider a feasible direction denoted by a symmetric matrix D ^ of 
appropriate size and a scalar t > 0. We further define the notation D' = HDH T and the function 

hx(t) = Tr(WC(C + X + *D')) 

where X = HQH T and C + X + tD are positive definite matrices. Since the direct channel matrix H 
is tall and full-rank, it follows that D' ^ 0. Moreover, by the definitions of W and C (fT8l)-(|20l, we 
know the matrix WC is symmetric and positive definite. It suffices to show the strict concavity of h\ 
with respect to t for each symmetric D. 

To prove the strict concavity of hi, we will calculate the second order derivative of hi with respect 
to t and prove that it is negative. If we denote B = (C + X + tD then the first order derivative is 
given by 

Shl _ MY (WC(C + X + tD')-) _ ^ ( {VbJi(wcb)) t 8B\ _ 



Bh 

-Tr(WCBDB). (29) 



dt ot V dt J 

In addition, we know that 

<9B 

St = 

V B Tr(WCB) = C T W T , 

which further implies 

~dt 

In a similar way, we can calculate the second order derivative 

= -2Tr (d'BWCBD'b) = -2Tr ((D'BD')(BWCB)) . (30) 

As C and B are positive definite we can conclude that BWCB is also positive definite and D BD is 
positive semi-definite. Since D BD ^ 0, it must have at least one non-zero eigenvalue A > with a 
corresponding eigenvector v. Then, 

^ = -Tr((D'BD')(BWCB)) 

< -ATr (v T v(BWCB)) 

= -ATr (v T (BWCB)v) 

= -ATr (v T (B(WC)2(WC)2B)v) 

= -A||(WC)5Bv|| 2 < 0. 
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Next we prove that the objective function in (fTTT ) is strictly convex in W^. The first summation in 
(fTTT ) is linear in W^'s and does not change the strict convexity. Moreover, the objective function in 
(fTTT ) is decomposable over W^. Hence, to accomplish the proof of lemma [JJ we just need to prove the 
strict convexity of — logdet(Wfc) in W^. For notational simplicity, we drop the index k, and prove the 
strict convexity of — logdet(W) along any feasible direction within the set of positive-definite matrices. 
Let G be a feasible direction and i be a positive scalar such that W + tG > 0. Then we define a 
one-dimensional parametrization of — log det ( W) along the direction G 

h 2 (t) = -Iogdet(W + tG). 

Using properties of the determinant function and the fact that W is positive-definite, we have 

h 2 (t) = -logdet(W 1 / 2 (I + tW- 1 / 2 GW- 1 / 2 )W 1 / 2 ) 

= -logdet(W) -logdet(I + £W- 1/2 GW~ 1/2 ) 

= -logdet(W) - ^log(l + tAi), 

i 

where A/'s are the eigenvalues of W -1 / 2 GW -1 / 2 and the last step of the above procedure is due to 
the fact that eigenvalues of I + X are one plus the eigenvalues of X. Obviously for any value of Aj the 
function — log(l + t\i) is convex with respect to t and for any non-zero Aj is strictly convex in t. Since 
G is non-zero and W is positive-definite, it follows that there exists at least one non-zero Aj which 
means that — J2i l°g(l + i s strictly convex. Thus, h,2(t) is strictly convex in t. ■ 

Lemma 2 Let {(Q£, be a stationary point of (fTTl) . then the point {Q* k }k=i ^ s a stationary 

point of ( fT5l ). Conversely, if {Q£}fLi JS a stationary point of (031 ), then {(Q£, Wjj^j-jjLj is a stationary 
point of Gg>, where W* = flfc(Q*) -1 , k = 1, 2, . . . , K. 

Proof: Let us use ^i(Q, W) and ^(Q) to denote the objective functions of (fTTT ) and (fT6t ) respec- 
tively, i.e., 

K K 

MQ, W) = $>fc ( W k9k(Q)) - J>gdet(W fc ), 
fc=i fc=i 

K 

^ 2 (Q) = ^logdet(<7 fc (Q)). 

fc=i 

Suppose {Q£, W^}^ 1 is a stationary point of ( fTTT ). Since the constraints in ( fTTT ) are separable in the 
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variables, we have 



Tr(V Q ^i(Q*,W*) T (Q fe -Q^)) > 0, k = 1,2, . . . ,K, 
Tr(V Wfc ^i(Q*,W*) T (W fc -W^)) >0, k = 1,2, . . . ,K, 



(31) 
(32) 



for any feasible point {Qk,Wk} k= !- By taking the gradient of ipi(-, •) with respect to and further 
simplifying (l32l ). we get 



Tr [(g k (Q*) - (W^)- 1 )(W fe - W%)] > 0. 
Since this inequality holds for any Wfc, it follows that 



W£ = g k (Q 



\/ k = 1,2, . . . ,K. 



(33) 



Fix any index £ and let us use q m ,n to denote the (m, n)-th entry in Q^. Differentiating using chain rule, 
we obtain 



dipt 



dQm,n 



K 



dg k (Q) 



(Q*,W*) 



dip 2 



dQm,n 



where the second equality follows from (I33b - This further implies that 

Tr (V Q ^ 2 (Q*f(Qfe - QD) =Tr(V Qfc V 1 (Q*,W*) T (Q fc -Q^)) >0 V k = 1, 2, . . . , K, (34) 

which guarantees the stationarity of the point {Q,* k } k =i f° r 03*- Furthermore, since the objective function 
in (fT6l ) and the objective function in (fT5T ) only differ in sign, the stationarity of {Qt}|L 1 in (fT6l) is 
equivalent to the stationarity of {Qt}fcLi for (fT5l) . To prove the converse, we can define W£ = <?fc(Q*) _1 , 
k = 1,2, ... ,K, and simply reverse the above argument to show that (I3TT) and (1321 hold. This further 
implies the stationarity of the point {(Q£, W^)}^ for ( fT71 ). ■ 
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